Supports real-time voice translation for nearly 100 languages with a delay of around 2 seconds, capable of replicating complex features such as speech pauses, tone, and speed. Utilizes a non-autoregressive architecture to support long sequence translations. Open-sourced four translation models along with relevant data and tools, adding audio watermarks to prevent model misuse and reduce translation toxicity.

1. Meta's newly open-sourced translation model SeamlessM4T supports translation in 100 languages and voices. 2. SeamlessM4T integrates the advantages of multiple translation models, including NLLB and MMS. 3. SeamlessM4T is trained on 270,000 hours of aligned speech and text data.